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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address ~ 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 1 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 . 1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 

- Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )^ Responsive to communication(s) filed on 24 February 2003 . 
2a)D This action is FINAL. 2b)^ This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
Disposition of Claims 

4) S Claim(s) 45-72 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) ^ Claim(s) 45-72 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10)D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
1 1 )□ The proposed drawing correction filed on is: a)D approved b)D disapproved by the Examiner. 

If approved, corrected drawings are required in reply to this Office action. 

12) Q The oath or declaration is objected to by the Examiner. 
Priority under 35 U.S.C. §§ 119 and 120 

13) Q Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 19(a)-(d) or (f). 

a)D All b)D Some*c)Q None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) D Acknowledgment is made of a claim for domestic priority under 35 U.S.C. § 1 1 9(e) (to a provisional application). 

a) □ The translation of the foreign language provisional application has been received. 
150 Acknowledgment is made of a claim for domestic priority under 35 U.S.C. §§ 120 and/or 121. 
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DETAILED ACTION: second action after RCE 
New Period for Reply 

1 . Applicant's representative George Simeon 703-836-6400 spoke with Examiner Garcia-Otero 
on 6/16/03 and 6/24/03. The prior office action (first action after RCE, mailed 4/9/03) 
inadvertently omitted discussion of pending claims 52 and 63. The Examiner regrets any 
inconvenience due to this omission. This new action remedies the omission, and supersedes 
the prior office action. 

2. The defect (inadvertent omission) was brought to the attention of the Office within the period 
for reply set in the Office action but more than 1 month after the date of the Office action, 
therefore "the Office will set a new period for reply. . . to substantially the time remaining in 
the reply period. . . at least one month" according to MPEP 710.06. 

3. The prior action was mailed 4/9/03, and the defect was discussed on 6/16/03. Less than one 
month remained in the reply period as of 6/16/03. Therefore, a new period for reply of 1 
month is set from the date of this action. This period is extendable under the provisions of 
37 CFR 1.136(a). 

Introduction 

4. Title is: HARDWARE SIMULATION SYSTEMS AND METHODS FOR VISION 
INSPECTION SYSTEMS 

5. First named Inventor is: WASSERMAN. 

6. Claims 45-72 of US Application 09/243,689 filed on 2/3/99, are presented for examination. 

7. This Action is in response to Applicant's Request for Continued Examination, received 
2/24/03. 

8. Claims 1-11, 13-18, 20-27, and 29-44 (all pending claims) have been cancelled. 

9. New Claims 45-72 have been added. 

10. As noted in the advisory action, all objections regarding the specification and drawings have 
been withdrawn, and the request for information has been satisfied. 

Index and Definitions 

11. Stevenson refers to "Modeling optical vision systems with innovative software" by Michael 
Stevenson et al., Vision Systems Design, January 1999, pages 29-35 (from IDS). 

12. Thomas refers to US Patent 5,137,450 (from PTO form 892). 
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13. Webster refers to Webster's Third New International Dictionary, Merriam- Webster Inc, CD 
version 2.5, copyright 2000. 

focus- 

1 : a point at which rays (as of light, heat, sound) converge or from which they diverge or 
appear to diverge; specifically : the point where the geometrical lines or their 
prolongations conforming to the rays diverging from or converging toward another point 
intersect and give rise to an image after reflection by a mirror or refraction by a lens or 
optical system 

2 a : FOCAL LENGTH <a telescope of twenty- feet focus> b : adjustment (as of the eye 
or an eyepiece) for distinct vision <a telescope or microscope comes sharply to focus> c 
: the position in which something must be placed (as in relation to a camera lens) for 
clearness of image or clarity of mental perception <the whole scene was difficult to bring 
into focus> <brought into immediate focus the meaning of the war> d : the area that may 
be seen distinctly by the eye or resolved into a clear image by a lens <wide-focus lens 
camera> 

3 : one of the points that with the corresponding directrix defines a conic section <conic 
foci>... 

-in focus : having or giving the proper sharpness of outline due to good 
focalization — used of an optical instrument or its parts or of an image 
depth of field 

: the range of distances of the object in front of a camera lens or other image- forming 
device measured along the axis of the device throughout which the image has acceptable 
sharpness 
depth of focus 

1 : the range of distances of the image behind a camera lens or other image-forming 
device measured along the axis of the device throughout which the image has acceptable 
sharpness 

2 : DEPTH OF FIELD — not used technically 
focal length 

: the distance from the principal point of a lens or concave mirror to the principal focus 

14. Computer User's Dictionary refers to MicroSoft Press Computer User's Dictionary, 
Microsoft Press, 1998, ISBN 1-57231-862-7. 

graphical user interface- 

A type of environment that represents programs, files, and options by means of icons, 
menus, and dialog boxes on the screen. The user can select and activate these options by 
pointing and clicking with a mouse or, often, by using the keyboard. . . 



New Matter 



15. The new claims are replete with new matter. 
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16. MPEP 608.04(a) states "Matter not in the original specification, claims, or drawings is 
usually new matter", and "new matter must be clearly identified by the examiner", and "If 
the new matter has been entered into the claims. . . should be rejected under 35 USC 1 12 first 
paragraph, because the new matter is not described in the application as originally filed". 
See also 37 CFR 1.121(f). See also MPEP 608, 706.03(c), 2163.03, and 2163.07 regarding 
basis in disclosure. 



17. The following is a quotation of the first paragraph of 35 U.S.C. 1 12: The specification shall 
contain a written description of the invention, and of the manner and process of making and using it, in such 
full, clear, concise, and exact terms as to enable any person skilled in the art to which it pertains, or with which 
it is most nearly connected, to make and use the same and shall set forth the best mode contemplated by the 
inventor of carrying out his invention. 

18. Claims 46-49, 51, 53, 62, 63, and 64 are rejected under 35 U.S.C. 1 12, first paragraph, as 

containing subject matter which was not described in the disclosure in such a way as to 
reasonably convey to one skilled in the relevant art that the inventor(s), at the time the 
application was filed, had possession of the claimed invention. 

19. The claims are replete with new matter: 

20. Claim 46 states "determines that a first part. . . discernably better focus". Although the 
specification does describe focus, there is not adequate description of how to determine if a 
part has "discernably better focus" than another part. This is new matter because there is no 
disclosure of discerning better focus. 

21 . Claim 47 states "appears and operates substantially similarly". This is new matter because 
there is no disclosure of substantially similar operation. 

22. Claim 48 states "manual motion control". This is new matter because there is no disclosure 
of manual motion control. 

23. Claim 49 states "plurality of lenses". This is new matter because there is no disclosure of 
using multiple lenses. 

24. Claim 51 states "graphical user interface". This is new matter because there is no disclosure 
of graphical user interfaces. 

25. Claim 53 states "at least one of a) a stage light and b) a coaxial light of the machine vision 
inspection system". This is new matter because there is no disclosure of specific types of 
lighting, in particular there is no disclosure of coaxial lights. 



Claim Rejections - 35 USC S 112- first paragraph- description 
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26. Claim 62 states "generates the current focus-dependent synthetic image... substantially 
similar to an image data format associated with the actual camera image processing of the 
machine vision inspection system". This is new matter because there is not adequate 
disclosure of image data formats. 

27. Claim 63 states "further comprising a control instruction generating portion, wherein the . 
machine vision inspection simulation system is further operable to generate at least one 
control instruction usable in an inspection program for the at least one object inspectable by 
the machine vision inspection system, based at least partially on the current state of the user- 
alterable control elements". This is new matter because there is no disclosure of "generating 
control instruction usable in an inspection system. . . based at least partially on the current 
state... " 

28. Claim 64 states "external view representing the overall configuration of the machine vision 
inspection system". This is new matter because there is not adequate disclosure of external 
views. 

Claim Rejections - 35 USC S 112-Second Paragraph-indefinite claims 

29. The following is a quotation of the second paragraph of 35 U.S.C. 112: The specification shall 
conclude with one or more claims particularly pointing out and distinctly claiming the subject matter which the 
applicant regards as his invention. 

30. Claim 46 is rejected under 35 U.S.C. 112, second paragraph, as being indefinite for 

failing to particularly point out and distinctly claim the subject matter which applicant 
regards as the invention. 

31. Claim 46 states "determines that a first part. . . discernably better focus". This is vague and. 
indefinite because although the specification does describe focus, there is not adequate 
definition of "discernably better focus". For example, a part may appear in focus at an initial 
magnification, but may appear out of focus at a higher magnification. Further, it is not clear 
if the "discerning" is performed by a human eye, or by some mathematical algorithm. 

Claim Rejections - 35 USC § 102(a) 

32. The following is a quotation of 35 U.S.C. 102(a) which forms the basis for the rejections 

under this section in this Office action: (a) the invention was known or used by others in this country, or 
patented or described in a printed publication in this or a foreign country, before the invention thereof by the applicant for a 
patent. 
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33. Claims 45, 46, 48, 49, 50, 52, 53, 55, 56 are rejected under 35 U.S.C. 102(a). 

34. Claim 45 is rejected under 35 U.S.C. 102(a) as being anticipated by Stevenson. 

35. Claim 45 is an independent "system" claim, with 5 limitations labeled A-E by the Examiner 
for clarity. Note that A has three subparts, B has 2 subparts, and E has 3 subparts. Said 
subparts are numerically labeled by the Examiner for clarity. 

36. Al-user interface... display a synthetic image is disclosed by Stevenson at page 29 
"Quality-control optical vision systems can be conveniently simulated and analyzed using 
software technology. . . simulate and analyze almost any optical vision system with high 
geometric and photometric accuracy". Note the car models displayed (synthetic images) at 
page 29 and page 30. Further note that these displays show tool bars and legends which are 
part of the user interface. 

37. A2-[user interface.. .] at least one control element that affects the focus is disclosed by 
Stevenson at page 32 "This type of analysis also permits designers to dissect the functional 
limitations inherent to their system. In this situation it is possible to decide the proper light- 
source intensity and position, imaging camera position, depth of focus, effective focal length, 
field of view, and CCD camera resolution". 

38. A3-[user interface. . .] input portion for receiving CAD data is disclosed by Stevenson at 
page 30 "This allows objects characterized in the Rhinoceros 3-D modeling program to be 
imported into ASAP for further analysis." 

39. Bl -hardware component simulation system... first portion... including a limited depth 
of field of the sense system is disclosed by Stevenson at page 32 "functional limitations 
inherent to their system. In this situation it is possible to decide the proper light-source 
intensity and position, imaging camera position, depth of focus, effective focal length, field 
of view, and CCD camera resolution". 

40. B2-[hardware component simulation system]... second portion... relative position is 
disclosed by Stevenson at page 32 "functional limitations inherent to their system. In this 
situation it is possible to decide the proper light-source intensity and position, imaging 
camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution". 
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41. C-communication interface... between the user interface and the hardware component 
simulation system is inherently disclosed by Stevenson at page 32 "functional limitations 
inherent to their system. In this situation it is possible to decide the proper light-source 
intensity and position, imaging camera position, depth of focus, effective focal length, field 
of view, and CCD camera resolution". Note that the displays at pages 29 and 30 inherently 
have a communication interface between the display monitor and the simulation system. 
Similarly, the keyboard and/or mouse which is used to interact with the toolbars inherently 
has a communication interface between the display monitor and the simulation system. 

42. D-control instruction generating portion is disclosed by Stevenson at page 32 "This type 
of analysis also permits designers to dissect the functional limitations inherent to their 
system. In this situation it is possible to decide the proper light-source intensity and position, 
imaging camera position, depth of focus, effective focal length, field of view, and CCD 
camera resolution". Note that to "decide" the "proper" parameters inherently means 
controlling them with instructions. 

43. El-is operable to. . . focus dependent synthetic image. . . based on at least 2 of a current 
state of the user-alterable control elements [focus], the current lens system 
representation of the first portion [depth of field], and the current state representation 
of the second portion [relative position] is disclosed by Stevenson at page 32 "This type of 
analysis also permits designers to dissect the functional limitations inherent to their system. 
In this situation it is possible to decide the proper light-source intensity and position, imaging 
camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution". 

44. E2-display the current focus-dependent synthetic image is disclosed by Stevenson at page 
29 "Quality-control optical vision systems can be conveniently simulated and analyzed using 
software technology. . . simulate and analyze almost any optical vision system with high 
geometric and photometric accuracy". Note the car models displayed (synthetic images) at 
page 29 and page 30. 

45. E3-generate at least one control instruction is disclosed by Stevenson at page 32 "This 
type of analysis also permits designers to dissect the functional limitations inherent to their 
system. In this situation it is possible to decide the proper light-source intensity and position, 
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imaging camera position, depth of focus, effective focal length, field of view, and CCD 
camera resolution". Note that to "decide" the "proper" parameters inherently means 
controlling them with instructions. 

46. Claim 46 is rejected under 35 U.S.C. 102(a) as being anticipated by Stevenson. 

47. Claim 46 depends from Claim 45. 

48. at least one control instruction... determines that a first part... will have discernably 
better focus... and that a second part... will [have] discernably poorer focus is disclosed 
by Stevenson at page 32 "This type of analysis also permits designers to dissect the 
functional limitations inherent to their system. In this situation it is possible to decide the 
proper light-source intensity and position, imaging camera position, depth of focus, effective 
focal length, field of view, and CCD camera resolution". Note that Webster defines "depth 
of focus" as "the range of distances of the image behind a camera lens or other image- 
forming device measured along the axis of the device throughout which the image has 
acceptable sharpness". Thus, any part of an object positioned in the "depth of focus" will 
have "acceptable sharpness". Additionally, note page 34 states "every optical- vision system 
has unique values determining its formal range of best focus". 

49. Claim 47 is rejected under 35 U.S.C. 103. 

50. Claim 48 is rejected under 35 U.S.C. 102(a) as being anticipated by Stevenson. 

51. Claim 48 depends from Claim 45. 

52. the at least one control element that affects the focus of the synthetic image comprises at 
least one of a) a focusing control element... is disclosed by Stevenson at page 32 "This 
type of analysis also permits designers to dissect the functional limitations inherent to their 
system. In this situation it is possible to decide the proper light-source intensity and position, 
imaging camera position, depth of focus, effective focal length, field of view, and CCD 
camera resolution". 

53. Claim 49 is rejected under 35 U.S.C. 102(a) as being anticipated by Stevenson. 

54. Claim 49 depends from Claim 45. 

55. plurality of lenses is disclosed by Stevenson at page 32 "This type of analysis also permits 
designers to dissect the functional limitations inherent to their system. In this situation it is 
possible to decide the proper light-source intensity and position, imaging camera position, 
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depth of focus, effective focal length, field of view, and CCD camera resolution". Note that 
if the physical system contained a plurality of lenses, then the analysis would inherently 
model the plurality of lenses. Further note that the use of lenses in series is well known in 
the art (telescopes), and the use of swapping lenses in a system is also well known in the art 
(microscopes). 

56. Claim 50 is rejected under 35 U.S.C. 102(a) as being anticipated by Stevenson. 

57. Claim 50 depends from Claim 45. 

58. displays a modified current focus dependent synthetic image in response to a 
modification of at least one of a) the current state of the user-alterable control 
elements... is disclosed by Stevenson at page 32 "This type of analysis also permits 
designers to dissect the functional limitations inherent to their system. In this situation it is 
possible to decide the proper light-source intensity and position, imaging camera position, 
depth of focus, effective focal length, field of view, and CCD camera resolution". Note that 
Claim 45 limitation A2 defines "user-alterable control elements" as "comprising at least one 
control element that affects the focus". 

59. Claim 52 is rejected under 35 U.S.C. 102(a) as being anticipated by Stevenson. 

60. Claim 52 depends from Claim 45. 

61. A- a third portion operable to represent a current state of a lighting system of the 
machine vision inspection system is disclosed by Stevenson at page 32 "This type of 
analysis also permits designers to dissect the functional limitations inherent to their system. 
In this situation it is possible to decide the proper light-source intensity and position, imaging 
camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution", 

62. B-the user alterable control elements comprise at least one control element that affects 
the apparent lighting in the synthetic image representative of an image acquired by the 
machine vision system is disclosed by Stevenson at page 32 "This type of analysis also 
permits designers to dissect the functional limitations inherent to their system. In this 
situation it is possible to decide the proper light-source intensity and position, imaging 
camera position, depth of focus, effective focal length, field of view, and CCD camera 
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resolution". Note that Stevenson's "decide the proper light-source intensity" inherently 
implies a control element that affects the apparently lighting. 

63. C-the off-line programming system is operable to generate the current focus-dependent 
synthetic image based on at least three of [1] a current state of the user alterable 
control elements, [2] the current lens system representative of the first portion 
[represent at least a current lens system... including a limited depth of field of the lens 
system], [31 the current state representation of the second portion [represent a current 
state of at least the relative position] and [4] the current representation of the third 
portion [represent a current lighting system] is disclosed by Stevenson at page 32 "This 
type of analysis also permits designers to dissect the functional limitations inherent to their 
system. In this situation it is possible to decide the proper light-source intensity and position, 
imaging camera position, depth of focus, effective focal length, field of view, and CCD 
camera resolution". Note Stevenson discloses all four of the sub-limitations (1 through 4). 
Further note that Stevenson's term "decide" means that Stevenson's listed factors are 
alterable, and that a current representation is generated based upon the current state of each 
factor. 

64. Claim 53 is rejected under 35 U.S.C. 102(a) as being anticipated by Stevenson. 

65. Claim 53 depends from Claim 52. 

66. at least one of a) a stage light and b) a coaxial light of the machine vision inspection 
system is disclosed by Stevenson at page 32 "This type of analysis also permits designers to 
dissect the functional limitations inherent to their system. In this situation it is possible to 
decide the proper light-source intensity and position, imaging camera position, depth of 
focus, effective focal length, field of view, and CCD camera resolution". 

67. Claim 55 is rejected under 35 U.S.C. 102(a) as being anticipated by Stevenson. 

68. Claim 55 is an independent claim, with 6 limitations A-F. Limitation A has 2 subparts, C has 
2 subparts, and F has 3 subparts. 

69. Al-user interface... display a synthetic image is disclosed by Stevenson at page 29 
"Quality-control optical vision systems can be conveniently simulated and analyzed using 
software technology. . . simulate and analyze almost any optical vision system with high 
geometric and photometric accuracy". Note the car models displayed (synthetic images) at 
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page 29 and page 30. Further note that these displays show tool bars and legends which are 
part of the user interface. 

70. A2-[user interface. . .] at least one control element that affects the focus is disclosed by 
Stevenson at page 32 "This type of analysis also permits designers to dissect the functional 
limitations inherent to their system. In this situation it is possible to decide the proper light- 
source intensity and position, imaging camera position, depth of focus, effective focal length, 
field of view, and CCD camera resolution". 

71. A3-[user interface...] at least one control element... image inspection operation is 
disclosed by Stevenson at page 30 "visual geometry inspection" and page 35 "searches the 
image for hot spots". 

72. B-input portion for receiving CAD data is disclosed by Stevenson at page 30 "This allows 
objects characterized in the Rhinoceros 3-D modeling program to be imported into ASAP for 
further analysis." 

73. CI -hardware component simulation system... first portion... including a limited depth 
of field of the lense system is disclosed by Stevenson at page 32 "functional limitations 
inherent to their system. In this situation it is possible to decide the proper light-source 
intensity and position, imaging camera position, depth of focus, effective focal length, field 
of view, and CCD camera resolution". 

74. C2-[hardware component simulation system]... second portion... relative position is 
disclosed by Stevenson at page 32 "functional limitations inherent to their system. In this 
situation it is possible to decide the proper light-source intensity and position, imaging 
camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution". 

75. D-communication interface... between the user interface and the hardware component 
simulation system is inherently disclosed by Stevenson at page 32 "functional limitations 
inherent to their system. In this situation it is possible to decide the proper light-source 
intensity and position, imaging camera position, depth of focus, effective focal length, field 
of view, and CCD camera resolution". Note that the displays at pages 29 and 30 inherently 
have a communication interface between the display monitor and the simulation system. 
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Similarly, the keyboard and/or mouse which is used to interact with the toolbars inherently 
has a communication interface between the display monitor and the simulation system. 

76. E-control instruction generating portion is disclosed by Stevenson at page 32 "This type 
of analysis also permits designers to dissect the functional limitations inherent to their 
system. In this situation it is possible to decide the proper light-source intensity and position, 
imaging camera position, depth of focus, effective focal length, field of view, and CCD 
camera resolution". Note that to "decide" the "proper" parameters inherently means 
controlling them with instructions. 

77. Fl-is operable to. . . focus dependent synthetic image. . . based on at least 2 of a current state 
of the user-alterable control elements [focus], the current lens system representation of 
the first portion [depth of field], and the current state representation of the second 
portion [relative position] is disclosed by Stevenson at page 32 "This type of analysis also 
permits designers to dissect the functional limitations inherent to their system. In this 
situation it is possible to decide the proper light-source intensity and position, imaging 
camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution". 

78. F2-display the current focus-dependent synthetic image is disclosed by Stevenson at page 
29 "Quality-control optical vision systems can be conveniently simulated and analyzed using 
software technology. . . simulate and analyze almost any optical vision system with high 
geometric and photometric accuracy". Note the car models displayed (synthetic images) at 
page 29 and page 30. 

79. F3-perform an image inspection operation based on the current focus-dependent 
synthetic image is disclosed by Stevenson at page 30 "visual geometry inspection" and page 
35 "searches the image for hot spots". 

80. Claim 56 is rejected under 35 U.S.C. 102(a) as being anticipated by Stevenson. 

81. Claim 56 depends from Claim 55, with one additional limitation 

82. generate at least one control instruction usable in an inspection program is disclosed by 
Stevenson at page 30 "visual geometry inspection" and page 35 "searches the image for hot 
spots". 
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Claim Rejections - 35 USC S 103 

83. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

A patent may not be obtained though the invention is not identically disclosed or described as set forth 
in section 102 of this title, if the differences between the subject matter sought to be patented and the 
prior art are such that the subject matter as a whole would have been obvious at the time the invention 
was made to a person having ordinary skill in the art to which said subject matter pertains. Patentability 
shall not be negatived by the manner in which the invention was made. 

84. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1, 148 USPQ 459 
(1966), that are applied for establishing a background for determining obviousness under 35 
U.S.C. 103(a) are summarized as follows: 

Determining the scope and contents of the prior art. 

Ascertaining the differences between the prior art and the claims at issue. 

Resolving the level of ordinary skill in the pertinent art. 

Considering objective evidence present in the application indicating obviousness or nonobviousness. 

85. Claims 47, 51, 52, 54, 57-72 are rejected under 35 U.S.C, 103(a) as being unpatentable. 

86. Claim 47 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in view of 
Thomas. 

87. Claim 47 depends from Claim 45. 

88. Stevenson does not expressly disclose the additional limitation. 

89. control element that affects the focus of the synthetic image appears and operates 
substantially similarly to a control element included in a user interface of the machine 
vision inspection system is disclosed by Thomas at FIG 3. Note that the Thomas flight 
simulator substantially duplicates the user interface of the actual airplane, including the 
control panel and control elements. Note Column 5 line 39 states "simulated heads-up 
display to complete the simulation for a typical tactical fighter". Thus, it is well known in 
the art to simulate the user interface as closely as possible for training purposes, even down 
to the pilot's chair. 

90. At the time the invention was made, it would have been obvious to a person of ordinary skill 
in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would have 
been motivated to do this to improve the training efficiency of the simulation by simulating 
the entire system as closely possible. Additionally, simply copying the user interface 
software modules into the simulation system would save developmental time. Further, the 
actual user interface hardware may also be used in order to save time and money. 
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91. Claim 51 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in view of 
Thomas. 

92. Claim 51 depends from Claim 45, with three additional limitations. 

93. A-graphical user interface including user-alterable control elements and an image 
display portion is disclosed by Stevenson at the figure on page 29. Note the toolbars that 
form part of the graphical user interface. 

94. Stevenson does not expressly disclose the remaining limitations. 

95. B-the substantially similar graphical user interface is disclosed by Thomas at FIG 3. 
Note that the Thomas flight simulator substantially duplicates the user interface of the actual 
airplane, including the control panel and control elements. Note Column 5 line 39 states 
"simulated heads-up display to complete the simulation for a typical tactical fighter". Thus, 
it is well known in the art to simulate the user interface as closely as possible for training 
purposes, even down to the pilot's chair. If the actual system being replicated contained a 
graphical user interface, then the simulation trainer would also have a similar graphical user 
interface. Additionally, note that Specification page 1 line 21 states "Off-line programming 
software tools are popular". The phrase "off-line" implies that the actual user interface is 
used, while only the measuring machines and robots are simulated. 

96. C-majority of the user-alterable control elements typically appear and operate 
substantially similarly in both the off-line programming system and the machine vision 
inspection system is disclosed by Thomas at FIG 3. Note that the Thomas flight simulator 
substantially duplicates the user interface of the actual airplane, including the control panel 
and control elements. Additionally, note that Specification page 1 line 21 states "Off-line 
programming software tools are popular". The phrase "off-line" implies that the actual user 
interface is used, while only the measuring machines and robots are simulated. 

97. At the time the invention was made, it would have been obvious to a person of ordinary skill 
in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would have 
been motivated to do this to improve the training efficiency of the simulation by simulating 
the entire system as closely possible. Additionally, simply copying the user interface 
software modules into the simulation system would save developmental time. Further, the 
actual user interface hardware may also be used in order to save time and money. 
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98. Claim 54 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in view of 
Thomas. 

99. Claim 54 depends from Claim 45, with three additional limitations. 

100. B-hardware component simulation system processes the input operation 
instructions in order to generate the current focus-dependent synthetic image is 

disclosed by Stevenson at page 32 "This type of analysis also permits designers to dissect the 
functional limitations inherent to their system. In this situation it is possible to decide the 
proper light-source intensity and position, imaging camera position, depth of focus, effective 
focal length, field of view, and CCD camera resolution". 

101. Stevenson does not expressly disclose the remaining limitations. 

102. A-input operation instructions which are substantially similar to the... machine 
vision inspection system is disclosed by Thomas at FIG 3. Note that the Thomas flight 
simulator substantially duplicates the user interface of the actual airplane, including the 
control panel and control elements. The physical user interface is duplicated, and the input 
operation instructions are implicitly duplicated as well. Note that Thomas' goal is "realistic 
flight simulation" at Column 1 line 17. 

103. C-hardware component simulation system generates the current focus-dependent 
synthetic image... substantially similar to... the machine vision inspection system is 
disclosed by Thomas at FIG 3. Note that the Thomas flight simulator substantially duplicates 
the user interface of the actual airplane, including the control panel and control elements. 
The physical user interface is duplicated, and the input operation instructions are implicitly 
duplicated as well. Note that Thomas' goal is "realistic flight simulation" at Column 1 line 
17. 

104. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

105. Claim 57 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 
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106. Claim 57 is an independent claim, with 5 limitations A-E. Limitation A has 4 subparts, C 
has 2 subparts, and E has 3 subparts. 

107. A2-[user interface. . .] at least one control element that affects the focus is disclosed by 
Stevenson at page 32 "This type of analysis also permits designers to dissect the functional 
limitations inherent to their system. In this situation it is possible to decide the proper light- 
source intensity and position, imaging camera position, depth of focus, effective focal length, 
field of view, and CCD camera resolution". 

108. A3-[user interface. . .] at least one control element... image inspection operation is 
disclosed by Stevenson at page 30 "visual geometry inspection" and page 35 "searches the 
image for hot spots". 

109. A4-majority of the user-alterable control elements typically appear and operates 
substantially similarly in both the machine vision inspection simulation system and the 
machine vision... is disclosed by Thomas at FIG 3. Note that the Thomas flight simulator 
substantially duplicates the user interface of the actual airplane, including the control panel 
and control elements. The physical user interface is duplicated, and any graphical user 
interface is implicitly duplicated as well. Note that Thomas' goal is "realistic flight 
simulation" at Column 1 line 17. One of ordinary skill in the art would understand that 
realistic simulation requires duplicating all interfaces as exactly as possible, including the 
control elements. 

110. B-input portion for receiving CAD data is disclosed by Stevenson at page 30 "This 
allows objects characterized in the Rhinoceros 3-D modeling program to be imported into 
ASAP for further analysis." 

111. CI -hardware component simulation system... first portion... including a limited 
depth of field of the lense system is disclosed by Stevenson at page 32 "functional 
limitations inherent to their system. In this situation it is possible to decide the proper light- 
source intensity and position, imaging camera position, depth of focus, effective focal length, 
field of view, and CCD camera resolution". 

112. C2-[hardware component simulation system]. . . second portion... relative position is 
disclosed by Stevenson at page 32 "functional limitations inherent to their system. In this 
situation it is possible to decide the proper light-source intensity and position, imaging 
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camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution". 

113. D-communication interface... between the user interface and the hardware 
component simulation system is inherently disclosed by Stevenson at page 32 "functional 
limitations inherent to their system. In this situation it is possible to decide the proper light- 
source intensity and position, imaging camera position, depth of focus, effective focal length, 
field of view, and CCD camera resolution". Note that the displays at pages 29 and 30 
inherently have a communication interface between the display monitor and the simulation 
system. Similarly, the keyboard and/or mouse which is used to interact with the toolbars 
inherently has a communication interface between the display monitor and the simulation 
system. 

1 14. El-is operable to. . . focus dependent synthetic image. . . based on at least 2 of a current 
state of the user-alterable control elements [focus], the current lens system 
representation of the first portion [depth of field], and the current state representation 
of the second portion [relative position] is disclosed by Stevenson at page 32 "This type of 
analysis also permits designers to dissect the functional limitations inherent to their system. 
In this situation it is possible to decide the proper light-source intensity and position, imaging 
camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution". 

115. E2-display the current focus-dependent synthetic image is disclosed by Stevenson at 
page 29 "Quality-control optical vision systems can be conveniently simulated and analyzed 
using software technology. . . simulate and analyze almost any optical vision system with 
high geometric and photometric accuracy". Note the car models displayed (synthetic 
images) at page 29 and page 30. 

116. E3-perform an image inspection operation based on the current focus-dependent 
synthetic image is disclosed by Stevenson at page 30 "visual geometry inspection" and page 
35 "searches the image for hot spots". 

117. Stevenson does not expressly disclose the remaining limitations. 

1 1 8. Al-user interface substantially similar to the graphical user interface of the machine 
vision inspection system... display a synthetic image is disclosed by Thomas at FIG 3. 
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Note that the Thomas flight simulator substantially duplicates the user interface of the actual 
airplane, including the control panel and control elements. The physical user interface is 
duplicated, and any graphical user interface is implicitly duplicated as well. Note that 
Thomas' goal is "realistic flight simulation" at Column 1 line 17. One of ordinary skill in the 
art would understand that realistic simulation requires duplicating all interfaces as exactly as 
possible, including graphical user interfaces. Note that graphical user interfaces are well 
known in the art, and are defined by Computer User Dictionary (1998) as "A type of 
environment that represents programs, files, and options by means of icons, menus, and 
dialog boxes on the screen. The user can select and activate these options by pointing and 
clicking with a mouse or, often, by using the keyboard. . .". 

119. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

120. Claim 58 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

121. Claim 58 depends from Claim 57, with one additional limitation. 

122. plurality of lenses is disclosed by Stevenson at page 29 "Quality-control optical vision 
systems can be conveniently simulated". The mathematics of multiple lenses in series is well 
known in the art, and common in telescopes. Additionally, swapping multiple lenses is well 
known in devices such as microscopes. 

123. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

124. Claim 59 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

125. Claim 59 depends from Claim 57, with one additional limitation. 
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126. at least one of a) the current state of the user-alterable control elements [focus], b) the 
current lens system representation of the first portion [depth of field], and c) the current state 
representation of the second portion [relative position] is disclosed by Stevenson at page 32 
"This type of analysis also permits designers to dissect the functional limitations inherent to 
their system. In this situation it is possible to decide the proper light-source intensity and 
position, imaging camera position, depth of focus, effective focal length, field of view, and 
CCD camera resolution". 

127. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

128. Claim 60 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

129. Claim 60 depends from Claim 57, with 3 additional limitations. 

130. current state of a lighting system is disclosed by Stevenson at page 32 "This type of 
analysis also permits designers to dissect the functional limitations inherent to their system. 
In this situation it is possible to decide the proper light-source intensity and position, imaging 
camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution". 

131. at least one control element that affects the apparent is disclosed by Stevenson at page 
32 "This type of analysis also permits designers to dissect the functional limitations inherent 
to their system. In this situation it is possible to decide the proper light-source intensity and 
position, imaging camera position, depth of focus, effective focal length, field of view, and 
CCD camera resolution". 

132. at least three of a) the current state of the user-alterable control elements [focus], b) 
the current lens system representation of the first portion [depth of field], and c) the 
current state representation of the second portion [relative position] and the current 
state representation of the third portion [image inspection] is disclosed by Stevenson at 
page 32 "This type of analysis also permits designers to dissect the functional limitations 
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inherent to their system. In this situation it is possible to decide the proper light-source 
intensity and position, imaging camera position, depth of focus, effective focal length, field 
of view, and CCD camera resolution" and page 30 "visual geometry inspection" and page 35 
"searches the image for hot spots". 

133. Note that the Examiner is interpreting "third portion" as meaning "image inspection" in 
view of parent claim 57. 

134. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

135. Claim 61 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

136. Claim 61 depends from Claim 60, with 1 additional limitations. 

137. at least one of a) a stage light and b) a coaxial light of the machine vision inspection 
system is disclosed by Stevenson at page 32 "This type of analysis also permits designers to 
dissect the functional limitations inherent to their system. In this situation it is possible to 
decide the proper light-source intensity and position, imaging camera position, depth of 
focus, effective focal length, field of view, and CCD camera resolution". 

138. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

139. Claim 62 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

140. Claim 62 depends from Claim 57, with 3 additional limitations. 

141. A-user-alterable control elements [focus]... substantially similar to... the machine 
vision inspection system is disclosed by Stevenson at page 32 "This type of analysis also 
permits designers to dissect the functional limitations inherent to their system. In this 
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situation it is possible to decide the proper light-source intensity and position, imaging 
camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution". 

142. B-generate the current focus-dependent synthetic image is disclosed by Stevenson at 
page 32 "This type of analysis also permits designers to dissect the functional limitations 
inherent to their system. In this situation it is possible to decide the proper light-source 
intensity and position, imaging camera position, depth of focus, effective focal length, field 
of view, and CCD camera resolution", and the displayed images at page 29 and page 30. 

143. C-generates the current focus-dependent synthetic image... substantially similar to 
an image data format associated with the actual camera image processing of the 
machine vision inspection system is disclosed by Stevenson at page 32 "This type of 
analysis also permits designers to dissect the functional limitations inherent to their system. 
In this situation it is possible to decide the proper light-source intensity and position, imaging 
camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution". 

144. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

145. Claim 63 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

146. Claim 63 depends from Claim 57, with 1 additional limitations. 

147. further comprising a control instruction generating portion, wherein the machine 
vision inspection simulation system is further operable to generate at least one control 
instruction usable in an inspection program for the at least one object inspectable by 
the machine vision inspection system, based at least partially on the current state of the 
user-alterable control elements is disclosed by Stevenson at page 32 "This type of analysis 
also permits designers to dissect the functional limitations inherent to their system. In this 
situation it is possible to decide the proper light-source intensity and position, imaging 
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camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution". Note that Stevenson's term "decide the proper. . . " means that the simulated 
system is used to determine the "proper" settings or control instructions for the actual system. 

148. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible, and then to operate the actual system at the 
optimum regions as found by the simulations. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

149. Claim 64 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

150. Claim 64 depends from Claim 57, with 1 additional limitations. 

151. external view representing the overall configuration of the machine vision inspection 
system is disclosed by Stevenson at page 32 "This type of analysis also permits designers to 
dissect the functional limitations inherent to their system. In this situation it is possible to 
decide the proper light-source intensity and position, imaging camera position, depth of 
focus, effective focal length, field of view, and CCD camera resolution". 

152. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

153. Claim 65 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

154. Claim 65 is an independent claim, with 4 limitations A-D. Limitation A has 2 subparts, 
B has 2 subparts, and D has 4 subparts. 

155. A2-[user interface. . .] at least one control element that affects the focus is disclosed by 
Stevenson at page 32 "This type of analysis also permits designers to dissect the functional 
limitations inherent to their system. In this situation it is possible to decide the proper light- 
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source intensity and position, imaging camera position, depth of focus, effective focal length, 
field of view, and CCD camera resolution". 

156. Bl -hardware component simulation system... first portion... including a limited 
depth of field of the lens system is disclosed by Stevenson at page 32 "functional 
limitations inherent to their system. In this situation it is possible to decide the proper light- 
source intensity and position, imaging camera position, depth of focus, effective focal length, 
field of view, and CCD camera resolution". 

157. B2-hardware component simulation system... first portion... including a limited 
depth of field of the lens system is disclosed by Stevenson at page 32 "functional 
limitations inherent to their system. In this situation it is possible to decide the proper light- 
source intensity and position, imaging camera position, depth of focus, effective focal length, 
field of view, and CCD camera resolution". 

158. C-communication interface... between the user interface and the hardware 
component simulation system is inherently disclosed by Stevenson at page 32 "functional 
limitations inherent to their system. In this situation it is possible to decide the proper light- 
source intensity and position, imaging camera position, depth of focus, effective focal length, 
field of view, and CCD camera resolution". Note that the displays at pages 29 and 30 
inherently have a communication interface between the display monitor and the simulation 
system. Similarly, the keyboard and/or mouse which is used to interact with the toolbars 
inherently has a communication interface between the display monitor and the simulation 
system. 

159. Dl -inputting CAD data is disclosed by Stevenson at page 30 "This allows objects 
characterized in the Rhinoceros 3-D modeling program to be imported into ASAP for further 
analysis." 

160. D2- focus dependent synthetic image... based on at least 2 of a current state of the 
user-alterable control elements [focus], the current lens system representation of the 
first portion [depth of field], and the current state representation of the second portion 
[relative position] is disclosed by Stevenson at page 32 "This type of analysis also permits 
designers to dissect the functional limitations inherent to their system. In this situation it is 
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possible to decide the proper light-source intensity and position, imaging camera position, 
depth of focus, effective focal length, field of view, and CCD camera resolution". 

161 . D3-displaying is disclosed by Stevenson at page 29 figure and page 30 figures. 

162. Degenerating at least one control instruction... based at least partially on the 
current state of the user-alterable control elements [focus] is disclosed by Stevenson at 
page 32 "This type of analysis also permits designers to dissect the functional limitations 
inherent to their system. In this situation it is possible to decide the proper light-source 
intensity and position, imaging camera position, depth of focus, effective focal length, field 
of view, and CCD camera resolution" and page 30 "visual geometry inspection" and page 35 
"searches the image for hot spots". 

163. Al-user interface... display a synthetic image representative of an image acquired 
by the machine vision system is disclosed by Thomas at FIG 3, and at Column 5 line 39 
"simulated heads-up display". Note that the simulated heads-up display includes machine 
vision images such as radar acquired artificial horizon and enemy fighters. Note that the 
Thomas flight simulator substantially duplicates the user interface of the actual airplane, 
including the control panel and control elements. The physical user interface is duplicated, 
and any graphical user interface is implicitly duplicated as well. Note that Thomas' goal is 
"realistic flight simulation" at Column 1 line 17. One of ordinary skill in the art would 
understand that realistic simulation requires duplicating all interfaces as exactly as possible, 
including graphical user interfaces. Note that graphical user interfaces are well known in the 
art, and are defined by Computer User Dictionary (1998) as "A type of environment that 
represents programs, files, and options by means of icons, menus, and dialog boxes on the 
screen. The user can select and activate these options by pointing and clicking with a mouse 
or, often, by using the keyboard. . .". 

164. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 
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165. Claim 66 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

166. Claim 66 depends from Claim 65, with 1 additional limitation. 

167. altering the at least one control element that affects the focus of the synthetic image 

is disclosed by Stevenson at page 32 "This type of analysis also permits designers to dissect 
the functional limitations inherent to their system. In this situation it is possible to decide the 
proper light-source intensity and position, imaging camera position, depth of focus, effective 
focal length, field of view, and CCD camera resolution". 

168. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

169. Claim 67 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

170. Claim 67 depends from Claim 65, with 1 additional limitation. 

171. displaying a modified current focus-dependent synthetic image... at least one of a) 
the current state of the user-alterable control elements [focus], b) the current lens 
system representation of the first portion [depth of field], and c) the current state 
representation of the second portion [relative position] is disclosed by Stevenson at page 
32 "This type of analysis also permits designers to dissect the functional limitations inherent 
to their system. In this situation it is possible to decide the proper light-source intensity and 
position, imaging camera position, depth of focus, effective focal length, field of view, and 
CCD camera resolution" and page 30 "visual geometry inspection" and page 35 "searches 
the image for hot spots". 

172. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 
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1 73. Claim 68 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

174. Claim 68 depends from Claim 65, with 1 additional limitation. 

175. at least one control element... image inspection operation is disclosed by Stevenson at 
page 32 "This type of analysis also permits designers to dissect the functional limitations 
inherent to their system. In this situation it is possible to decide the proper light-source 
intensity and position, imaging camera position, depth of focus, effective focal length, field 
of view, and CCD camera resolution" and page 30 "visual geometry inspection" and page 35 
"searches the image for hot spots". 

1 76. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

177. Claim 69 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

178. Claim 69 is an independent claim, with 7 limitations A-G. Limitation A has 4 subparts, 
B has 2 subparts. 

179. A2-[user interface. . .] at least one control element that affects the focus is disclosed by 
Stevenson at page 32 "This type of analysis also permits designers to dissect the functional 
limitations inherent to their system. In this situation it is possible to decide the proper light- 
source intensity and position, imaging camera position, depth of focus, effective focal length, 
field of view, and CCD camera resolution". 

180. A3-[user interface. . .] at least one control element... image inspection is disclosed by 
Stevenson at page 30 "visual geometry inspection" and page 35 "searches the image for hot 
spots". 

181. Bl -hardware component simulation system... first portion... depth of field is 

disclosed by Stevenson at page 32 "This type of analysis also permits designers to dissect the 
functional limitations inherent to their system. In this situation it is possible to decide the 
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proper light-source intensity and position, imaging camera position, depth of focus, effective 
focal length, field of view, and CCD camera resolution". 

182. B2-second portion.*, relative position and the [third] portion... inspection is 
disclosed by Stevenson at page 32 "This type of analysis also permits designers to dissect the 
functional limitations inherent to their system. In this situation it is possible to decide the 
proper light-source intensity and position, imaging camera position, depth of focus, effective 
focal length, field of view, and CCD camera resolution" and page 30 "visual geometry 
inspection" and page 35 "searches the image for hot spots". 

183. C-communication interface... between the user interface and the hardware 
component simulation system is inherently disclosed by Stevenson at page 32 "functional 
limitations inherent to their system. In this situation it is possible to decide the proper light- 
source intensity and position, imaging camera position, depth of focus, effective focal length, 
field of view, and CCD camera resolution". Note that the displays at pages 29 and 30 
inherently have a communication interface between the display monitor and the simulation 
system. Similarly, the keyboard and/or mouse which is used to interact with the toolbars 
inherently has a communication interface between the display monitor and the simulation 
system. 

184. D-inputting CAD data is disclosed by Stevenson at page 30 "This allows objects 
characterized in the Rhinoceros 3-D modeling program to be imported into ASAP for further 
analysis." 

185. E-focus-dependent synthetic image... based on at least 2 of a current state of the 
user-alterable control elements [focus], the current lens system representation of the 
first portion [depth of field], and the current state representation of the second portion 
[relative position] is disclosed by Stevenson at page 32 "This type of analysis also permits 
designers to dissect the functional limitations inherent to their system. In this situation it is 
possible to decide the proper light-source intensity and position, imaging camera position, 
depth of focus, effective focal length, field of view, and CCD camera resolution". 

186. F-displaying the current focus-dependent synthetic image is disclosed by Stevenson at 
page 29 "Quality-control optical vision systems can be conveniently simulated and analyzed 
using software technology. . . simulate and analyze almost any optical vision system with 
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high geometric and photometric accuracy". Note the car models displayed (synthetic 
images) at page 29 and page 30. 

187. G-operating at least one control element which is operable to perform an image 
inspection operation is disclosed by Stevenson at page 32 "This type of analysis also 
permits designers to dissect the functional limitations inherent to their system. In this 
situation it is possible to decide the proper light-source intensity and position, imaging 
camera position, depth of focus, effective focal length, field of view, and CCD camera 
resolution" and page 30 "visual geometry inspection" and page 35 "searches the image for 
hot spots". 

188. Stevenson does not expressly disclose the remaining limitations (Al and A4). 

189. Al-user interface*.* display a synthetic image representative of an image acquired 
by the machine vision system is disclosed by Thomas at FIG 3, and at Column 5 line 39 
"simulated heads-up display". Note that the simulated heads-up display includes machine 
vision images such as radar acquired artificial horizon and enemy fighters. Note that the 
Thomas flight simulator substantially duplicates the user interface of the actual airplane, 
including the control panel and control elements. The physical user interface is duplicated, 
and any graphical user interface is implicitly duplicated as well. Note that Thomas' goal is 
"realistic flight simulation" at Column 1 line 17. One of ordinary skill in the art would 
understand that realistic simulation requires duplicating all interfaces as exactly as possible, 
including graphical user interfaces. Note that graphical user interfaces are well known in the 
art, and are defined by Computer User Dictionary (1998) as "A type of environment that 
represents programs, files, and options by means of icons, menus, and dialog boxes on the 
screen. The user can select and activate these options by pointing and clicking with a mouse 
or, often, by using the keyboard. . .". 

190. A4-majority of the user-alterable control elements [focus] and image processing 
tools typically appear and operate substantially similarly is disclosed by Thomas at FIG 
3. Note that Thomas' goal is "realistic flight simulation" at Column 1 line 17. One of 
ordinary skill in the art would understand that realistic simulation requires duplicating all 
interfaces as exactly as possible, including control elements and image processing tools. 
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191. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

192. Claim 70 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

193. Claim 70 depends from Claim 69, with 1 additional limitation. 

194. displaying a modified current focus-dependent synthetic image... at least one of a) 
the current state of the user-alterable control elements [focus], b) the current lens 
system representation of the first portion [depth of field], and c) the current state 
representation of the second portion [relative position] is disclosed by Stevenson at page 
32 "This type of analysis also permits designers to dissect the functional limitations inherent 
to their system. In this situation it is possible to decide the proper light-source intensity and 
position, imaging camera position, depth of focus, effective focal length, field of view, and 
CCD camera resolution" and page 30 "visual geometry inspection" and page 35 "searches 
the image for hot spots". 

195. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

196. Claim 71 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

197. Claim 71 depends from Claim 69, with 1 additional limitation. 

198. focus-dependent synthetic image on the current state representation of the third 
portion [lighting] is disclosed by Stevenson at page 32 "This type of analysis also permits 
designers to dissect the functional limitations inherent to their system. In this situation it is 
possible to decide the proper light-source intensity and position, imaging camera position, 
depth of focus, effective focal length, field of view, and CCD camera resolution". 
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199. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 

200. Claim 72 is rejected under 35 U.S.C. 103(a) as being unpatentable over Stevenson in 
view of Thomas. 

201. Claim 72 depends from Claim 69, with 1 additional limitation. 

202. inspection disclosed by Stevenson at page 30 "visual geometry inspection" and page 35 
"searches the image for hot spots". 

203. At the time the invention was made, it would have been obvious to a person of ordinary 
skill in the art to use Thomas to modify Stevenson. One of ordinary skill in the art would 
have been motivated to do this to improve the training efficiency of the simulation by 
simulating the entire system as closely possible. Additionally, simply copying the user 
interface software modules into the simulation system would save developmental time. 



204. The new claims are replete with new matter. 

205. All pending claims stand rejected against prior art. 

206. Stevenson discloses simulating optical vision systems in great detail, including importing 
CAD, lens focus effects, lighting, position, inspection and so forth. However, Stevenson 
does not explicitly address simulating the user interface systems (both hardware and 
software) that inherently form an integral portion a quality-control optical vision system. 

207. Thomas discloses flight simulation systems which includes an almost exact duplication of 
the user interface hardware, and includes simulating machine vision (radar) on a heads-up 
display. Thomas discloses the importance of "realistic" simulation. 



208. The following US patents or publications are hereby cited as prior art, but have not been 
used for rejection. Applicant should review these carefully before responding to this office 
action. 



Conclusion 



Additional Cited Prior Art 
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209. Shinoda US Patent 4,639,588 discloses "automatic imaging lens focusing device. . . near 
focus state, a far focus state or an in- focus state" at Abstract. 

210. Burns US Patent 6,298,284 discloses "the use of two cameras with different focal 
lengths allows the best focus on both the front and rear whells at the same time with no 
single lens compromise" at Column 5 line 25. 



211. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Eduardo Garcia-Otero whose telephone number is 703-305- 
0857. The examiner can normally be reached on Monday through Thursday from 9:00 AM 
to 7:00 PM. 

212. If attempts to reach the Examiner by telephone are unsuccessful, the Examiner's 
supervisor, Kevin Teska, can be reached at (703) 305-9704. The fax phone numbers for this 
group are: 

213. (703) 746-7238 — for communications after a Final Rejection has been made; 

214. (703) 746-7239 — for other official communications; and 

215. (703) 746-7240 — for non-official or draft communications. 

216. Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the group receptionist, whose telephone number is (703) 305-3900. 



Communication 
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